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"IMAGE PROCESSING METHOD AND MEDICAL VIEWING SYSTEM FOR CORRELATING 

FEATURES IN MEDICAL IMAGES" 

Description 

Field of the Invention 

5 The present invention relates to an image processing method of correlating features in 

medical images. The invention further relates to a medical viewing system having means for 
carrying out this method and to a medical examination apparatus having such a medical 
viewing system. The invention also relates to a computer program product having instructions 
for carrying out the method steps. The invention finds its application in the field of medical 

10 imaging and, more especially, in the field of ultrasound medical imaging. 

Matching one shape with respect to another is often needed in particular to compare 
medical images together. The amount of calculations needed is often problematic when dealing 
with 2D or 3D images or when a time sequence of such images has to be processed. The need 
for computationally efficient and accurate procedures is most acute when dealing with real-time 

15 applications. 

Background of the Invention 

An Image Registration Technique is already described by T. Netsch, P. Rosch, A. van 
Muiswinkel and J. Weese in the publication entitled 'Towards real-time multi-modality 3-D 
medical image registration", Computer Vision, 2001. ICCV 2001, Proceedings of Eighth IEEE 

20 International Conference, vol.1, pp. 718 -725 (2001). This cited Reference compares Medical 
Image Registration based on "Mutual Information" and "Local Correlation. The "Local 
Correlation" based method produces better or superior results to those of "Mutual Information", 
and besides requires considerably fewer computations. The "Local Correlation" used in the 
method is a similarity measure of gray-levels within pairs of small regions, defined by 

25 "windows", in two images to be matched together. The registration then consists in looking for 
the transformation of one image that will result in the largest possible value of the sum of such 
"Local Correlations" over pairs of corresponding windows in the two images. Different strategies 
are proposed in the cited publication to select the windows in each of the images being 
compared and to select which pairs of windows have to be compared. The choice of the 

30 strategy basically depends on the nature of transformation needed, called rigid or non-rigid 
transformations. 

Even though results obtained with the "Local Correlation" based technique are 
promising, computation times are still a problem when dealing with large image data, in 
particular in the case of image processing in real time and in 3-D. Furthermore, robustness has 
35 to be improved in particular when dealing with non-rigid registration. To avoid matching 

together local shapes, which are only partly similar, the windows to compare with each other 
have to be large. In this case, each "Local Correlation" evaluation is computation intensive 
because it often Involves image warping procedures requiring complex numerical algorithms. 
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Summary of the Invention 

It is an object of the invention to propose an image processing method to quickly and 
accurately register one shape relative to another shape that are each defined within an Image 
window. This method is applicable to match shapes observable in image signal or image data 
5 with any number of dimensions such as: ID signals, 2D, 3D, 2D+time, 3D+time images. The 
present method further allows of determining the image transformation that provides the best 
match between two shapes that are each defined within a window. It is a further object of the 
invention to provide a method that is especially appropriate to match two objects, having 
complex shapes. This method is applicable to set in correspondence one part of the complex 
10 shape of a first image with one part of the complex shape of a second image in order to 
perform local correlation of said parts of the first and second complex shapes. 

The main steps of this method are recited in Claim 1. Specific embodiments of the 
invention are claimed in dependent Claims. 

A medical viewing system for carrying out this method is further proposed. The medical 
15 viewing system can be implemented as a specially programmed general-purpose computer. The 
medical viewing system can be a workstation. The present invention yet further provides a 
computer program product having a set of instructions, when in use on a general-purpose 
computer, to cause the computer to perform the steps of the above-described method. The 
present invention still further provides a medical examination apparatus incorporating medical 
20 imaging apparatus, data processing system putting into practice the above-described method to 
process medical image data obtained by the imaging apparatus, and means for visualizing the 
image data produced by the method. The visualization means typically consists of a monitor 
connected to the data processing apparatus. Advantageously, the workstation and medical 
imaging system of the present invention are interactive, allowing the user to influence clinical 
5 data that are evaluated and/or the manner in which evaluated data is to be visualized. 

Brief Description of the Drawings 
The invention and additional features, which may be optionally used to implement the 
invention to advantage, are described hereafter with reference to the schematic figures, where: 
RG.l is a functional block diagram of the correlation means of the imaging system of 
I the invention; 

FIG.2A and FIG.2B illustrate the matching of two shapes using the correlation means; 
HG.3 is a functional block diagram of a medical Imaging system according to the 
invention; 

RG.4 Is a functional block diagram of a medical examination apparatus using the 
imaging system of the invention. 

Description of Embodiments 

The invention relates to an image processing method of correlating features, hereafter 
called shapes, in medical images. The invention further relates to a medical viewing system 
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having means for carrying out this method and to a medical examination apparatus having such 
a viewing system. 

The invention defines an image processing method to find a similarity measure 
between two shapes each defined within a Gaussian window. It provides the key components 
for quickly and accurately matching two objects having complex shapes in medical images. The 
processing method requires prior computation of "Hermite Transforms" of the shapes to match 
together within their respective windows. This operation allows of representing each of the 
shapes to be matched by a set of n scalar valued Hermite Transform coefficients". These scalar 
valued Hermite coefficients can be ordered in such a way that low-order coefficients code the 
coarse shape information whereas the high order coefficients code fine details. The new 
proposed processing method provides a way to compute the correlation between the shapes to 
match in a computationally simple manner by combining the scalar valued Hermite Transform 
coefficients related to the two shapes. This allows of computationally efficiently determining the 
best matching transformation. The computation burden is particularly small if coarse 
transformation estimates are required. It is particularly suited for a coarse to fine registration 
approach. 

In the new processing method, the class of transformations, which can be 
simultaneously dealt with, are: 

for any data dimension: translation, scale-change; and, in addition 
for data dimensions higher than ID: rotation, anisotropic scale change. 

This method is especially appropriate to match two objects having complex shapes. 
This method is applicable to set in correspondence one part of the complex shape of the first 
object with one part of the complex shape of the second object in order to perform a local 
correlation of said parts of the first and second complex shapes. 

The processing method is suited to match shapes in medical images, which either come 
from a single imaging modality, modalities, such as Ultrasound, X-ray, MRI or Nuclear Isotope 
Imaging, or to match together shapes observable in images of different modalities. 

The present invention preferably makes use of mathematical tools based on a 
polynomial functions such as the Hermite transform. Said Hermite Transform allows the analysis 
of a 1-dimensional image signal (1-D) or of a m-dimenstonal image signal (m-D) with m>l 
within an isotropic Gaussian Window characterized by a size parameter a. This allows to 
represent the data by a set of " scalar valued Hermite Coefficients" which can be ordered in 
such a way that low order coefficients represent coarse, or low frequency, shape information 
within the Gaussian windows, whereas high order coefficients represent finer details, or high 
frequencies. Essentially, a Hermite Transform allows to reconstruct the original signal or image 
data within a Gaussian window with very small error near the center of the Gaussian window, 
for example within a distance less than 2a from the window center. 
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The steps of the method of the Invention are illustrated by the block-diagram of FIG.l. 
FIG.l is a block diagram for the computation of the windowed correlation function K(v) for 
image signals ffe) and g(y) respectively. Each of the two image signals is defined within a 
given Gaussian window Wl, W2 around center points jc- and Yc respectively. The sizes of the 
two windows Wl, W2 are defined by the scale parameters a t and a 2 respectively. HT stands 
for taking the Hermite Transform to convert a scalar valued signal f(20 or g(y) into a set of 
scalar valued Hermite coefficients. This image processing method can apply to (mage signals 
depending on one independent variable corresponding to 1-dimensional (1-D) Image or can 
apply to Image signals having m independent variables corresponding to m- dimensional images 
(m-D images). The scalar valued Hermite coefficients depend on indices I, which are either 
simple non-negative Integers In 1-D or multiple indices (vectors of m-integer Indices). The 
boxes marked rotation Rxor R 2 are applicable only for m>l. They convert the set of scalar 
valued Hermite coefficients into a new set corresponding to a rotated version of the 
corresponding image. The box marked HT" 1 takes the scalar valued Hermite correlation 
coefficients K, and produces the correlation function KQ0 computed to a desired accuracy. Best 
matching occurs when the translation parameter y together with those defining relative scaling 
factors { z k > as well as the rotations R x and R 2 of image signals f(x) and g(y) result in the 
highest value of K(jc). The steps of this method are described hereafter in detail, comprising: 

1) In an image, definition of the image intensity f in function of the location of each 
image pixel or image voxel. So, the scalar value image intensity f is given as function of the real 
positional coordinates. Besides, a positive valued function is introduced to define a fuzzy 
observation window W in the image. In the present method of the invention, for correlating 
two shapes found in two images or in two parts of an image, two m-dimensional signals or 
image Intensities fQc) and g&), are respectively defined in steps referenced 11, 21, with mssl. 
Each signal or image intensity is defined within a respective window called first window Wl and 
second window W2. The windows Wl, W2 are respectively centered around points Xcand jfe. 
The windows are each defined by respective size parameters CTl and <y 2 . A fuzzy Gaussian 
window function Is associated with each of these windows, which is maximum near the window 
center and decays proportionally to exp(-(d q /o q ) 2 ) when moving away from the window 
center where d q is the distance from the respective window center, where subscript q is 1 for 
the first window and 2 for the second window. The present method has steps to form a 
correlation algorithm as follows: 

2) Evaluation of the Hermite Transform, denoted by HT, in steps referenced 12, 22, for 
fQc) and g(y) each In Its respective window Wl, W2. 

3) The previous step 2 results in two sets of scalar valued Hermite Transform 
coefficients { fi } and { gi } respectively, referenced 13, 23, where each coefficient is labeled 
with an index I, which is just a non-negative integer (i) for 1-D signals where m«l, or is a 
multiple index I=(ii,...,i m ) for multidimensional Image data where m>l. 
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4) Rotation referenced 14, 24. For data dimension m larger than 1, the image signals 
f(x) and g(y) may be pre-rotated around their respective window center x c , y c using 
respectively the (mxm) rotation matrices R x and R 2 . These rotations are not operated on the 
original image signals f(x) and gCy). Instead, they are operated on the scalar valued Hermite 
Transformed Coefficients { fi } and { g i } respectively making use of the fact their values 
convert under rotation like tensors. 

FIG.2 illustrates the principle to find pre-rotation matrices R x and R 2 to apply to image 
f(x) and g(y) about their respective window center as part of the general processing method 
outlined in Figure l. The case illustrated is for 2-D images (m=2) and when anisotropic scale 
change is required for matching the two shapes. Rotations R t and R 2 are those which align 
shape principal directions of respective image signals f(x) and g(y) with predefined co-ordinate 
axes. 

5) The new converted scalar valued Hermite coefficients { F x } and { G x } referenced 
15, 25 are respectively obtained as linear combinations of the old coefficients { f r } and 

{ 9i }. The linear conversion from the set of scalar valued Hermite coefficients { f r } to the set 
{ F r } is calculated by standard techniques using the first rotation matrix R x . Likewise, the 
conversion from the set of scalar valued Hermite coefficients { g x } to { G r } makes use of the 
second rotation matrix R 2 . The optimum determination of the pre-rotation matrices Ri and R 2 
can be done in different ways according to the application, in particular: 

If anisotropic scaling has to be introduced for matching the two shapes 
corresponding to the image signals f(x) to g(y), the principal directions of each shape within 
its window are determined and the images are rotated so that the principal directions coincide 
with the predefined axes of co-ordinates as schematically shown In FIG.2. 

If no anisotropic scaling needs to be performed, one of the two rotations may 
be set to the identity (no rotation) and the other is determined as part of the general 
optimisation processing method described in the following step below. 

6) In step referenced 31, for the situations where either anisotropic or isotropic scaling 
is needed, performing a computation of the combination of the scalar valued Hermite 
coefficients { F x } and { G x } using a combination function. This computation provides a new 
set of Hermite Transform Coefficients that will further be used to compute a correlation 
function K(v). The combination formula for computing the Hermite Transform Coefficients K x 
can favorably be as follows: 



{) |l-J-valkl} k-0 ^ UJ J 



FjGj-j (l) 



where the summation extends over all multi-Indices defined by: 

J — GlrJ2/—/jm) 

(2a) 

(1-3) = ( Ir-jj, fe-ja,..., i m -j m ) (2 b) 



6 
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where 3 and (IO) are valid indices or multi-indices for which all entries are non-negative 
integers, while 



(3 



(3) 

stands for a binomial coefficient, and: 

«k =1 /V 1 + Z u (4a) 

#k =Zk/V 1 + z k (4b) 
and where z k is a scaling factor to apply to the co-ordinate number k of Qc-Xc). 

Hence, if anisotropic scaling is needed, the coefficients ccr, p k permit of changing scale 
along all the different axes of co-ordinates. 

If isotropic scaling is needed, this is a special case for which all z k values are equal. 

If no scaling is needed, this is another special case for which all z k values are equal to 1 
resulting in that: a* = p k = l/V2 . 

7) In step referenced 32, using Hermite Transform Coefficients { K z }, the inverse 
Hermite Transform (HT 1 ) allows to estimate a further set of scalar coefficients of a function 
called correlation function K(y). 

8) In step referenced 33, the correlation function K(v) is computed, where y is a 
set of translation parameters. The number of Hermite coefficients Id to use and the set of 
translation parameters v for which K(y) is computed can be determined according to the 
desired accuracy. For a coarse estimate, only low order indices (I) should be used and only few 
sampling points for j£ are needed. The maximum value of K(v) among all calculated values 
provides the similarity measure and the corresponding optimum translation parameters v. 

9) The above combination of steps can be repeated several times if necessary to reach 
the best possible similarity measure by modifying the rotation matrices R x , R*, the scaling 
factors { z k } and by increasing the number of indices 1,3 if more accuracy is needed. A 
standard strategy may be used for this optimisation. 

10) Once this optimisation is done, one may derive the best transformation that will 
provide the best match of one image to the other under the matrix equation form: 

X - RjZ 2 R 2 ^yJ+RjBv + x c ( 5a) 

and: 

y = RjZ 1 R 1 (x-x c )+RjAv + y c (5b) 

where Z x and Z 2 are both (mx m) diagonal matrices with: 

matrix Z± has diagonal element at row and column k, equal to a 2 ZiJa lf and 
matrix Z 2 has diagonal element at row and column k, equal to ai/(a 2 ZK); 

and where A and B are also both (mx m) diagonal matrices with: 

matrix A has diagonal element at row and column k f equal to a 2 /cck, and 
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matrix B has diagonal element at row and column k equal to oxf$u, 
where at, a* zk, cck, p k , y are defined above. 

Even more economy In computation load can be achieved when one is interested in 
studying a restricted dass of image transformations. 

In particular, if only translations in the direction defined by co-ordinate number n is 
involved, the above evaluations of {K X J, can be limited only to multi-indices I=(ii/...,i m ) for 
which i k =0 for all co-ordinate numbers k*n. This allows to compute a one dimensional 
correlation function K(v„) depending on the one dimensional co-ordinate v n of the m- 
dimensional translation parameter y .Considerably less computations are then needed to find 
the optimum of K(y„) as compared to the calculations needed to find the optimum of K(y) 
which has an m-dimensional independent variable. 

The present invention further relates to a viewing system having computing means for 
carrying out the steps of the image processing method of the invention and having display 
means to visualize the processed images. Hence, this system has means for computing the 
correlation (or degree of similarity) of two image signals each defined within its own isotropic 
Gaussian window. More specifically, the present method and system relate to the evaluation 31 
of the Hermite Transform K x of a windowed correlation function K(y) in 33, comprising using a 
Hermite Transform HT in 12, 22, of two image signals f(x) and g(y), each defined in 11, 21, in 
a window Wl, W2, wherefrom the inverse Hermite Transform HT" 1 is evaluated in 32 to obtain 
the correlation function K (y) in 33. 

Compared with the state of the art techniques, this current method and system deal 
with the following issues: 

In addition to translation, which is handled by means 31 of computing the Correlation 
Coefficients, and/or to rotation, which is handled by rotation matrices R t and R 2 , respectively 
14 and 24, the method and system of the invention also has means 33 of computing the 
translation correlation function K(y), which handles change of scale. This means 33 allows of 
estimating the effect of altering scale (isotropically or not) in one image signal relative to the 
other while, at the same time, taking in account the effect of translation and rotation. This is a 
unique feature, which is not present in other state of the art approaches to compute local 
correlation. 

Accurate registration is possible with fewer computations than for state of the art 
methods in particular when large correlation blocks need to be used. 

The amount of calculations required to obtain the correlation function is adaptable to 
the accuracy of match that is required. The number of Hermite coefficients Ki to use and the 
set of translation parameters y for which K(y) is computed are determined according to the 
desired accuracy. This method and system permit of calculating the correlation function K(y) to 
a desired accuracy in sub-sampling the set of possible translation parameters y for which the 
correlation is to be computed. For a coarse estimate, only low order indices (I) and only few 
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sampling points for y are used. This leads to very few calculations if a coarse match is needed, 
which also minimizes calculations for a "coarse to fine approach". 

When the correlation function K(y) is evaluated in multi-dimensional images, it may be 
calculated for a translation parameter y. varying in a direction parallel to one coordinate axis at 
a time with great saving in computations. 

The method and system present a possibility to remove the effect of the local mean 
intensities from the correlation for example by skipping multi-indices which have all zero 
entries in the Hermite Transforms of both images. 

An important issue that is dealt with by the method and system is a possibility of 
matching images with inverse contrast. This problem occurs when images coming from 
different sources such as x-rays and MRI are considered. This problem is solved by looking for 
both positive maxima AND negative minima of KQO and using the absolute value | K(y) | 
instead of K(y). This aspect is important when matching such images coming from different 
modalities in which case the contrast of an anatomical feature in one image may be inverted 
with respect to that of the other. 

These method and system present a possibility of matching features which have 
different amplitudes in the two images by dividing K(y) or | K(y) | by the product of local root 
mean square image amplitudes. 

Better robustness can be obtained against noise as compared to state of the art. 
The techniques of the state of the art need to warp one of the images relative to the 
other even for local correlation. This may produce artifacts and is computationally costly. This is 
totally avoided in the method and system of the invention for local correlation. Such warping 
operations are replaced by much simpler manipulations of the Hermite coefficients of the 
images and of the correlation function. 

The above-described image viewing method, which is based on a windowed correlation 
technique, can be used as a key component of a freeform or elastic matching technique. One 
possible version of such technique is described below as an example. 

As illustrated by FIG.2B, a complex shape called SHAPE 1 must be matched to a 
complex shape called SHAPE 2 represented respectively in a first image and in a second image. 
For matching SHAPE 1 and SHAPE 2, It may be necessary to warp linearly or non-linearly one of 
the shapes. The disks shown in the two images of the shapes indicate local windows in each 
image, in which gray level intensities vary appreciably. Each of the images to match is paved 
with a number (preferably large) of such windows. To find the warping law, one can proceed in 
successive iterations as follows: 

a) An initial guess of the warping law is provided (for example using a global 
alignment procedure known from the state of the art), 

b) For each of the windows Wl, such as Wll, W12, W13, in one of the 
images, called first image, which window is centered around a point the current guess of the 
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warping law is used in order to find the corresponding location t in the other image, called 
second image, as well as an approximate anisotropic scale change and rotation within the 
window Wl introduced by the warping law using state of the art technique. The locations of all 

windows W2 k are looked for in the second image, having their centers y (k) within a maximum 

5 distance from point t, which distance is determined by the algorithm user. If no such window 
exists in the second image, window Wl is discarded. 

c) If the window Wl is not discarded: for each of the windows W2 k in the 
second image, the method proposed in the invention is used together with the information 
obtained in above step b) to obtain the correlation between window W2 k in the second image 

10 and window Wl in the first image. The maximum correlation C k is determined together with 
the corresponding translation At k needed to match W2 k in order to the warped window Wl 
which mapped around point fi. 

d) The maximum correlation C k is stored as C together with the corresponding 
translation At k as At. 

15 e) The above two steps (c) and (d) are repeated for all non-discarded windows 

Wl in the first image. From all the translations At, modify the warping law to better describe 
matching of the two images using state of the art techniques. The goodness of fit rate G is 
calculated from the sum of local correlations C over all windows Wl divided by the number of 
non-discarded windows Wl. 

20 f) Steps b) to e) above are repeated, up to a maximum number of user defined 

iterations or when the goodness of fit rate G is considered satisfactory (/.& above a level 
determined by the algorithm user). 

g) The best warping obtained is considered as the one that maximizes the sum 
of local correlations. 

25 FIG.2B illustrates the scheme for registration using a given deformation law. Circles 

symbolize the windows Wl in the first image and the corresponding windows W2 in the 
second image. The arrows symbolize the correspondence between windows that maximizes the 
local correlation. For instance, windows W21, W22, W23 in the second image respectively 
correspond to windows Wll, W12, W13 in the first image. 

30 The above-described steps can be carried out by the viewing system of the invention. 

FIG.3 shows a diagram of a medical viewing system 150 according to the invention for 
carrying out all the steps of the above-described method. The system has means 151 for 
acquiring digital image data of a sequence of images, and is coupled to computer means 153 
for processing these data according to the processing method cited above. The medical viewing 

35 system can be used in the intervention room or near the intervention room for processing real 
time images. Steps of the present method can be applied on stored medical images, for 
example for estimating medical parameters. The medical viewing system provides the image 
data by connection 157 to the system 153. The system provides processed image data to 




PHFR020124 EPp 

display means and/or storage means. The display means 154 may be a screen. The storage 
means may be a memory of the system 153. Said storage means may be alternately external 
storage means. This image viewing system 153 may comprise a suitably programmed 
computer, or a special purpose processor having circuit means such as LUTs, Memories, Filters, 
Logic Operators, that are arranged to perform the functions of the method steps according to 
the invention. The system 153 may also comprise a keyboard 155 and a mouse 156. Icones 
may be provided on the screen to be activated by mouse-clicks, or special pushbuttons may be 
provided on the system, to constitute control means 158 for the user to start, to control the 
duration or to stop the processing means of the system at chosen stages or phases. 

Fig.4 shows the basic components of an embodiment of an image viewing system in 
accordance to the present invention, incorporated in a medical examination apparatus. As 
indicated schematically in Fig.4, the medical examination apparatus typically includes a bed 110 
on which the patient lies or another element for localizing the patient relative to the imaging 
apparatus. The medical imaging apparatus may be a CT scanner 151. The image data 
produced by the CT scanner 151 is fed to data processing means 153, such as a general- 
purpose computer, that carries out the steps of the method. The data processing means 153 is 
typically associated with a visualization device, such as a monitor 154, and an input device 155, 
such as a keyboard, pointing device, etc. operative by the user so that he can interact with the 
system. The data processing device 153 is programmed to implement a method of processing 
medical image data according to invention. In particular, the data processing device 153 has 
computing means and memory means to perform the steps of the method. A computer 
program product having pre-programmed instructions to carry out the method may also be 
implemented. 

The present invention is applicable regardless of the medical imaging technology that is 
used to generate the initial data. For example, when seeking to visualize the heart, magnetic 
resonance (MR) coronary angiography may be used to generate 3D medical image data in a 
non-invasive manner. Various modifications can be made to the order in which processing steps 
are performed in the above-described specific embodiment. The above-described processing 
steps applied to medical image data can advantageously be combined with various other known 
processing/visualization techniques. The drawings and their description herein before illustrate 
rather than limit the invention. It will be evident that there are numerous alternatives that fall 
within the scope of the appended claims. Moreover, although the present invention has been 
described in terms of generating image data for display, the present invention is intended to 
cover substantially any form of visualization of the image data including, but not limited to, 
display on a display device, and printing. Any reference sign in a claim should not be construed 
as limiting the claim. 



11 



PHFR020124 EPp 



CLAIMS: 

1. An processing method comprising an evaluation (31) of a Hermite Transform (K x ) for 
the evaluation (33) of a windowed correlation function K(y), including steps (12, 22) of using 
the Hermite Transform (HT) of two image signals (f(x), g(y)) representing shapes defined in 
respective windows (Wl, W2) in multi-dimensional Images (m-D), wherefrom a step (32) of 
evaluating the inverse Hermite Transform (HT 1 ) is performed to achieve the computation (33) 
of said windowed correlation function (K(v))- 

2. The method of Claim 1, wherein the scalar valued Hermite coefficients (Ki, fi> gi) are 
ordered in such a way that low-order coefficients code the coarse shape information whereas 
the high order coefficients code fine details. 

3. The method of one of Claims 1 or 2, wherein the class of simultaneously 
transformations, which is dealt with for any data dimension m, comprises; 

translation (33), scale-change (31). 

4. The method of one of Claims 1 to 3, wherein the class of simultaneous transformations, 
which is dealt with for data dimensions higher than 1-D, comprises: 

translation (33), scale-change (31), 

and, in addition 

rotation (14, 24) and anisotropic scale change (31). 

5. The method of Claim 4, comprising, for a number of variables superior to one 
corresponding to data dimensions higher than 1-D: 

processing the scalar valued Hermite coefficients (ft, gi) by applying at least one 
rotation matrix (Rl, R2) which converts at least one of the two sets of scalar valued Hermite 
coefficients (fj, g r ) into a new set of scalar valued Hermite coefficients (Fi, Gi) corresponding 
to a rotated version of at least one of the shapes; 

estimating at least one new set of scalar valued Hermite coefficients (Fr, Gi) 
corresponding to the rotated version of at least one of the shapes. 

estimating a set of scalar valued Hermite correlation coefficients (K r ) from the new sets 
corresponding to the rotated versions of the shapes (F&. G t ). 

6. The method of one of Claims 1 to 5, comprising: 

setting the number of scalar valued Hermite correlation coefficients (Ki) to use and the 
set of translation parameters (v) for which the correlation function (K(v)) is to be computed in 
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order to provide a desired accuracy, according to which for a coarse estimate only low order 
indices (I) and a limited number of sampling points for translation parameters (v) are used, 
while the maximum value of the correlation function (K(v))/ among all calculated values, 
provides the correlation measure and the corresponding optimum translation parameter (v). 

7. The method of Claim 6, comprising: 

setting the number of scalar valued Hermite correlation coefficients (K x ) to use, when 
only translations in the direction defined by a given co-ordinate number (n) is involved, 
comprising limiting said evaluations of scalar valued Hermite correlation coefficients (Ki) to 
multi-indices I=(i 1/ ... / i m ) for which i k =0 for all co-ordinate numbers k*n, wherefrom 
computing a one dimensional correlation function (K(v n )) depending on the one dimensional 
co-ordinate (v„) of the m-dimensional translation parameters (yr). 

8. The method of one of Claims 1 to 7, comprising: 

repeating the steps of determining the correlation function, as many times as necessary 
in order to reach the best possible correlation function by modifying the rotation matrices (Ri, 
R 2 ), the scaling factors ({ z k }) and by increasing the number of indices (I) if more accuracy is 
needed. 

9. The method of one of claims 1 to 8, comprising an evaluation of a warping law for 
correlating a first and a second complex shape in multi-dimensional images (m-D), including the 
determination of more than one window (Wl) for the first shape and the determination of 
corresponding candidate windows (W2 k ) for the second shape, and further comprising the 
estimation (31) of the Hermite Transform (K x ) for the evaluation (33) of a windowed correlation 
function K(v), including steps (12, 22) of using a Hermite Transform (HT) of two image signals 
(f (x)/ g(5£)) defined in respective windows (Wl, W2), wherefrom a step (32) of evaluating the 
inverse Hermite Transform (HT 1 ) is performed to achieve the computation (33) of said 
windowed correlation function (K (a)), which is used to determine the best candidate windows, 
and comprising the determination of the best warping law by iteration of these steps in order to 
match the first and second complex shapes. 

10. A medical viewing system comprising means for carrying out an image processing 
method according to one of Claims 1 to 9, to be applied in multi-dimensional images (m-D), 
comprising: 

computation means (31) for estimating the Hermite Transform (Ki) for the evaluation 
(33) of a windowed correlation function K(v)/ including means (12, 22) for computing a 
Hermite Transforms (HT) of two image signals (f(x), g(S0) representing shapes defined in 
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respective windows (Wl, W2), to which Hermite Transform (K x ) further means (32) evaluate 
the inverse Hermite Transform (HT 1 ) to achieve the computation (33) of said windowed 
correlation function; and 

display means for visualizing the correlated shapes and/or processed images. 

5 

11. A medical examination apparatus comprising acquisition means for acquiring medical 
image data, and a medical viewing system according to Claim 10. 

12. A computer program product having a set of instructions, when in use on a general- 
10 purpose computer, to cause the computer to perform the steps of the method according to of 

Claims 1 to 9. 
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"IMAGE PROCESSING METHOD AND MEDICAL VIEWING SYSTEM FOR CORRELATING 
FEATURES IN MEDICAL IMAGES" 

5 Abstract 

An image processing method comprising an evaluation (31) of an Hermite Transform 
(Ki) for the evaluation (33) of a windowed correlation function K(V), including steps (12, 22) of 
using a Hermite Transform (HT) of two image signals (f(x), g(y)) representing shapes defined 
in respective Gaussian windows (Wl, W2) in multi-dimensional images (m-D), wherefrom a 

10 step (32) of evaluating the inverse Hermite Transform (HT 1 ) is performed to achieve the 
computation (33) of said windowed correlation function (K(v))« 

The invention also relates to medical viewing system having computing means to carry 
out this method. This system has means for applying rotation, translation and scale change on 
the scalar valued Hermite coefficients of the image signals and the correlation function, instead 

15 of on the images. This system can correlate very complex shapes having parts that locally show 
different deformations from the global complex shapes. 



Figure : 1 
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